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Meth od of Design thereof ai>c 
Conn^utar Program Product 



ro non-rlinear systems, 



The present invention relates 

of design thereof in the frequency domain and 

More particularly, the present 
non- linear system having p re- 
characteristics . The 



methods 

computer program products . 
invention relates to a 
determinable frequency response 
invention can be utilised no design and realise, for 
nonlinear 'filters having a required frequency 
response or transfer functions having specified transfer 
characteristics or within a control system context. 



10 axample, 



The possible frequency components in an output signal 
15 of a linear sy=tem are exactly the same as the frequency 
components of a corresponding input signal. Conventional 
linear filter design is based on the principle that energy 
in unwanted frequency bands is attenuated. 



20 



25 



30 



The Dolby filter, which varies the amplitude of the 
output signal as a function of the level and frequency of 
the input, is an example of a nonlinear filter system. 
However, when compared with the input, the output does not 
contain any additional frequency components. Modulation is 
another concept related to nonlinear filtering, which xs 
associated with signal transmission where the signal to be 
transmitted is modulated by' a carrier signal and then 
transmitted through a medium. Although a modulation devxce 
allows energy, to be moved from one frequency band to 
another, the output frequency components of such a device 
depend not only on the input components but mainly on the 
carrier signal. Therefore, the energy transfer implemented 
by modulation is realised by a two input and one output 
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system where one input Is nhe carrier signal and the other 
input is the signal ro be processed. 

The prior art lacks a non-linear system and method 
of/apparatus for the design of such ^ noix-liaaar system for 
predictably transferring energy from one fre<iuency or band 
of frequencies of an input signal to another frequency or 
band of frequencies independently of any other input signal. 
Further, the prior art lacks a non-linear control system 
which can predictably transfer energy from one frequency 
band to another frequency band. 

It is an object of the present invention to at least 
mitigate some of the problems of the prior art. 

Accordingly, a first aspect of the present invention 
provides a method for -designing a non-linear system for 
transferring energy from a time or spatial domain input 
signal having a first spectrum ^t a first pre-determinable 
frequency or range of frequencies to a time or spatial 
domain output signal having a second spectrum at a second 
pre-determinable frequency or range of frequencies. 

Preferably, the method comprises the steps of 
identifying the first .pectrum of the time or spatial domain 
input signal from which energy is to be transferred, 
specifying the second spectrum of the time or spatial domain 
output signal to which said energy is to be transferred, and 
calculating, using a frequency domain description of said 
output signal, for example, the output spectrum, expressed 
in terms of a frequency domain description of saxd input 
sxgnal and coefficients of " a time or spatial doma:Ln 
description of a generalised non-linear sysram, the 



30 
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coefficients of a said "time or spatial domain description of 
said generalised non-linear system in order to give effect 
to the energy transfer , 



allows energy at a particular frequency within a given 
system to be transferred to another frequency or band of 
frequencies at which the response of the system is greatly 
reduced or negligible,* or 

10 allows energy of a signal which is transmitted at a 
particular frequency or band ' of frequencies to be 
transferred, without using an additional modulating signal, 
to another frequency or band of frequencies at which the 
associated transmission media allows signals to pass, or 

15 allows energy at a particular band of frequencies to be 
transferred and spread over a new wider range of frequencies 
so as to attenuate the energy by employing th© desired 
interkernel and intrakernel effects of nonlinear systems » 

20 The present invention is based upon the relationship 

between the input and output spectra or frequency components 
of nonlinear systems, and the relationship between the input 
and output frequencies and/or frequency ranges in the 
nonlinear case. In addition, the invention utilises a 

25 mapping between the time or spatial domains and frequency 
dom3.in which allows the output spectra or frequency content 
of nonlinear systems to be described completely by- the 
coefficients of time or spatial domain models which 
represent the filter or non-linear system to be constructed. 

30 A second aspect of the present invention provides a 

method for manufacturing a non-linear system for 
transferring energy from a time or spatial domain input 



5 



Advantageously, the present invention 
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Signal having a first spectrum at a first pra-detenainable 
frequency or range of frequencies to a time or spatial 
domain output signal having a second spectrum at a second 
pre-de terminable frequency or range of frequencies, said 
merhod of manufacture comprising che steps of 

(a) designing said non-linear system comprising the seeps of 
identifying the first spectrum of the time or spatial domain 
input signal from which energy is to be transferred, 
specifying the second -spectrum of the time or spatial domain 
output signal to which said energy is to be transferred, and 
calculating, using a frequency domain description of said 
output signal, for example,- the output spectrum, expressed 
in tftrms of a frequency domain description of said input 
signal and coefficients of a ciine or spatial domain 

15 description of a generalised non-linear system, the 
coefficients of a time or spatial domain description of said 
generalised non-linear system in order to give effect to the 
energy transfer, and 

(b) materially producing the non-linear system so designed. 

20 

A third aspect of the present invention provides a data 
processing system which can transfer energy from a time or 
spatial domain input signal having a first spectrum at a 
first pre-determinable frequency or range of frequencies to 
25 a time or spatial domain output signal having a second 
spectrum at a second pre-determinable frequency or range of 
frequencies, said system comprising 

means for identifying the first spectrum of the time or 
spatial domain input signal from which energy is to be 
30 transferred, 



4 



SUBSTITUTE SHEET (RULE 26) 



30-08-00 1 1 :52 Frorn:HARRI SON GODDARD FOOTE 



+441142730312 



T-663 P. 12/99 Job-687 




WO 99/45644 PCT/G 899/00550 

means for specifying the second spectrum of the time or 
spatial domain output signal to which said energy is to be 
transferred/ and 

means for calculating, using a frequency domain description 
S of said output signal, for example, the output spectr^m, 
expressed in terms of a frequency domain description of said 
input signal and coefficients of a time or sparlal domain 
description of a generalised non-linear system, the 
coefficients of a time or spatial domain description of said 
10 generalised non-lineaf system in order to give effect to the 
energy transfer, 

A fourth aspect of the present invention provides a 
computer program product for designing a non-linear system 

15 for transferring energy from a time or spatial domain input 
signal having a first spectrum at a first pre-determinable 
frequency or range of frequencies to a time or spatial 
domain output signal having a second spectrum at second 
pre-determinable frequency or range of frequencies^ said 

20 computer program product comprising 

computer program code means for identifying the first 
spectrum of the time or spatial domain input signal from 
which energy is to be transferred, 

computer program code means for specifying the second 
25 spectrum of the time or spatial domain output signal to 
which said energy is to be transferred, and 

computer program code means for calculating, using a 
frequency domain description of said output signal, for 
ejcample, the output spectrum, expressed in terms of a 
30 frequency domain description of said input signal and 
coefficients of a time or spatial domain description of a 
generalised non-linear system, the coefficients of a time or 
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spatial domain description of said generalised non-linear 
system in order to give effect to the energy transfer, 

A fifth aspect of the presenr invention provides a non- 
s linear system which can transfer energy from a time or 
spatial domain input signal having a first spectrum at a 
first pre-dererminable frequency or range of frequencies to 
a time or spatial domain output signal having a second 
spectrum at a second pre-determinable frequency or range of 
10 frequencies, said system comprising 

means for identifying the first spectrum of the time or 
spatial domain input signal from which energy is to be 
transferred/ 

rneans for specifying the second spectrum of the time or 
15 spatial domain output signal to which said energy is to be 
transferred, and 

maans for giving effect to the energy transfer using 
coefficients of a time or spatial domain description of a 
generalised non-linear system, said coefficients having been 
20 calculated using a frequency domain description of said 
output signal, for example, the output spectrum, expressed 
in terms of a frequency domain description of said input 
signal and coefficients of a time or spatial domain 
description of a generalised non-linear system- 

25 

Advantageously; the fifth embodiment allows processing 
for the determination of the coefficients to be performed 
off-line and merely incorporated into a non-linear system 
which uses the coefficients. 

30 
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Embodiments of the present invention will be described 
by way of examples only, with reference to the accompanying 
in which: 

figure 1 shows the effect of traditional signal 
5 processing by, for example, a linear filters- 
figure 2 illustrates signal processing according to one 
aspect of the present invention; 

figure 3 depicts a further example of the signal 
processing according t9 the present invention; 

10 figure 4 shows a non- linear system arranged to give 

effect to the energy transformation shown in figure 3; 

figure 5 illustrates a further energy transformation in 
which energy is distributed over a wider frequency band; 

figure 6 illustrates the power spectral densities for 
15 the input and output signals of a designed nonlinear system; 

figure 7 illustrates the power spectral densities for 
the input and output signals of another designed nonlinear 
system; 

figure 5 depicts schematically a non--linear system; 

20 figure 9 shows a digital implementation of the non- 

linear system shown in figure 8; 

figure 10 illustrates the power spectr-al densities for 
the input and output signals of the nonlinear system which 
was obtained using a design which improves the filtering 

25 effect shown in figure 6; 

figure 11 illustrates the power spectral densities for 
the input and output signals of the nonlinear system which 
was obtained using a design which improves the filtering 
effect shown in figure 7; 



7 



SUBSTITUTE SHEET (RULE 26) 



30-08-00 11:53 From: HARRISON GODDARD FOOTE 



+441142730312 



T-653 P. 15/99 Job-687 




WO 99/45644 PCT/GB99/00SS0 

figure 12 shows the time domain input and output of the 
nonlinear system with the frequency domain filtering effect 
shown in figure 10; 

figure 13 shows the time domain input and output of the 
5 nonlinear system with the frequency domain filtering effect 
shown in figure 11; 

figure 14 depicts the structure of a designed nonlinear 
system; 

figure 15 illus,trates the frequency spectrum of a 
10 signal to be processed using the present invention; 

figure 16 illustrates the result of a Fast Fourier 
Transform of an input signal having the spectrum shown in 
figure 15; 

figure 17 illustrates the results of the n-dimensional 
15 (n= 2 and 3) convolution integration for the spectxruju shown 
in figure 16; 

figure 18 illustrates the output magnitude frequency 
response of a designed nonlinear system to an input signal 
having the frequency spectrum shown in figure 15; 

20 figure 19 shows the frequency spectrum of a further 

signal to be processed using the present invention; 

figure 20 illustrates the output magnitude frequency 

response of the same nonlinear system as shown in figure 18 

to the further signal to be processed having the frequency 
25 spectrum shown in figure 19; 

figure 21 illustrates the frequency spectrum of a still 
further signal to be processed using the present invention; 

figure 22 illustrates the output magnitude frequency 

response of the same nonlinear system as in figure 18 to the 

30 still fuarther signal to be processed having the frequency 
spectrum shown in figure 21; 
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figure 23 ilLustrares the structure of another designed 
nonlinear systems- 
figure 24 shows the continuous time realisation of the 
discrete time syatem in figure 23; 

figure 25 shows a mechanical implertiencatioTi of the 
continuous time system in figure 24; 

figure 26 illustrates the result of a Fast Fourier 
Transform of the further signal shown in figure 19; 

figure 27 illustrates the output magnitude frequency 
response of a further designed nonlinear system to the 
further signal shown in figure 19; 



figure 28 illustrates the output magnitude frequency 
response of a still further designed nonlinear system to the 
15 signal shown in figure 15; 

figure 29 illustrates the output magnitude frequency 
response of the nonlinear system shown in figure 28 to the 
further signal shown in figure 19; 

figure 30 illustrates a flow chart for designing a 
nonlinear system according to an embodiment; 

figure 31 illustrates a flow chart for designing 
nonlinear system according to a further embodiment; 



20 



a 



25 



30 



figure 32 shows the structure of a nonlinear filter 
designed based on specifications for both the magnitude 
and phase of output frequency responses; 

figure 33 depicts the input and output magnitude 
frequency characteristics of a specific nonlinear filter 
designed based on specifications for both the magnitude 
and phase; 
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figure 34 shows the phase angle of the spectriaiu 
^zU^) in figure 32 in the specific design case shown in 
figure 33 which reflects the phase response 
characteristic determined by the designs- 
figure 35 shows the phase characteristics of me 
linear phase FIR filter in the specific design case shown 
in figure 33; 

figure 36 depicts the discrete time model of a 
nonlinear filter designed to focus energy from two 
different frequency bands into a single frequency band; 

^ figure 37 shows the spectrum of an input signal of 

li5 the nonlinear filter in figure 36; 

% figure 38 shows the frequency response of the 

1 nonlinear filter in figure 3 6 to the input in figure 37, 

" which indicates an energy focus effect of the nonlinear 

^20 filter; 

J figure 39 illustrates the block diagram of a spatial 

^; domain nonlinear filter; 

figure 40 depicts the power spectral densities of an 
input and the corresponding output of the spatial domain 
nonlinear filter in figure 39; 

figure 41 depicts an spatial domain input and 
30 corresponding output of the filter In figure 39; 

figure 42 shows a one dimensional image to be 
processed by the spatial domain nonlinear filter in 
figure 39; 

35 

10 
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figure 43 shows the one dimensional image obtained 
by processing the image in figure 42 using che spatial 
domain nonlinear filter in figure 3 9; and 

figure 4 4 illustrates a dana proc^^ssing system upon 
which embodiments of the present invention can be 
implemented. 



Referring to figure I, there is shown the principle of, 
10 for example, traditional low pass, high pass, and band pass 
filtering. Figure 1 shows the power spectrum of a signal 
100 both before and after processing. The energy of a 
signal 100 to be filtered comprises two parts, namely, a 
first part 102 for further processing or of interest and a 
15 second part 104 which is of no interest. Typically, the 
second part 104 of the signal is attenuated which results in 
a second signal 106. The second signal 106 comprises the 
original or a copy of the first part 102 and an attenuated 
portion or an attenuated version of the second part 108, 

20 

Figure 2 illustrates the principle of signal processing 
according to one aspect of the present invention. Figure 2 
shows the power spectriim of a signal 200 both before and 
after processing. The signal comprises a first portion 202 

2S and a second portion 204, The first portion 202 of the 
signal 200 is of interest for further processing or output , 
Accordingly, as a result of the signal processing using the 
present invention, the first portion 202 is retained and the 
energy in the second portion 204 is translated to another 

30 frequency band 20 6. 
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I, DETAILED DECRIPTION 

The theory and method anderiying the present invention 
will now be described in general tenns in steps (i) co (vi) , 

5 (i> Determine the frequency spectrum of a signal ro be 
processed, including the range of frequencies of the signal. 



<ii) Specify the frequency spectrum of the output signal, 

10 (xii.) Determine the structure of a Nonlinear Auto-Regressive 
model with exogenous inputs (NARX model) to ensure that the 
energy transformation between different frequency bands and 
other design requirements, for example, specifications for 
magnitude and/or phase of the output spectrum over the 

13 required output frequency band can be met or realised. 

The general expression for a NARX model is given by 

N 

y(k) = I]y„(k) (1) 

where yn(k> is a 'NARX nth-order output' given by 

20 

p-01,,lp^^=i i = l i = pi-l 

(2) 

with 

25 pi-q=;n, 1^=1,., ,,K^, i = l,,.,,p + q, and X - Z"* Z 

is the maximum lag and y(-). u{.). and c^^( .) are the 

output/ input, and model coefficients respectively. A 
specific instance of the NARX model such as 

y(k) = 0.2u(k-l)-^Q.ly(k-l)-0.02u(k-l)u{k-l)-'O.Q^u(k'2)u(k-l} 
30 -0 , 06y (k-l) u (k-3)-Q .OBy (k-2) y (k-i) 

may be obtained from the general form (1) and (2) with 

12 
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coi(l)=Q-3, cio(l)=0,7, C02 (1. D— 0.02, co2 (2, 1) =^-0 . 04, 
cii (1, 3)=-0.06, C20(2,3)=-0,08, else Cp<y(-)=0 

5 Simplified designs will be considered below where the 

NARX model with only input nonlinearities ia employed. 
However/ it will be appreciated by one skilled in the art 
that the present invention is not limited to use in relation 
to only input nonlinearities . The present invention can 

10 equally well be used in circxxmstances of both non-linear 
outputs and non-linear inputs and outputs. Equally, the 
invention is nor restricted to realisation as a NARX model. 
The invention may be realised using many alternative model 
forms either in discrete time or continuous time* Models 

15 such as the Hammerstein and Wiener model, or continuous time 
models^ for example, a nonlinear differential equation model 
could be used or any other model, including discrete or 
continuous spatial models, that can be mapped into the 
frequency domain. However, for each of the models the main 

20 design principle is the same. 

The NARX model with only input nonlinearities is given 
by equation (1) where 



25 



30 



Xc^(l,,--vljn^(k-l,) for n^2 

^c,o<l,)y(k~l,)+|;;coi(li)xa(k-l,) for n=l 



The structure of the NARX model (1) and (3) is defined 

by the valuesi of K^, n^l , , . . , N, and, for each n (an 

integer between 1 and A/ indiisive) , involves nerms o£ the 
form 

n 

Co„(li/-A„)n"(^-ii> li=l,...,K„, i = l n, 
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when n > 2 and 

c,o(lJ y (k-1,) , Co^(l^)u(lC".l^) , 1. 
5 when n-1 in the model , 

The parameter N in the non^linear model (1) and (3) is 
associated with the realisability of the model required to 
give effect to the energy rrans formation* The ability to be 
10 able to realise the energy transformation is determined from 
th© relationship between the input and output: frequencies or 
frequency ranges of non-linear systems- 

The structure parameters K^^, n = l,,„,N, are associated 
15 wich the extent to which specific design requirements such 
as Che magnitude and/or phase of the output spectrum oxrer 
the required output frequency band can be satisfied. These 
parameters are iteratively determined as part: of the design. 
The model could initially be assumed to be of a simple form 
20 in rerms of these paxametiera . Howevei:, if the initial 
choice of parameters does not produce a satisfactory design 
the parameters are progressively or gradually revised 
according to the energy transfer effect of the resulting 
non- linear system. 

25 

For systems described by the NARX model (1) and (3), 
the relationship between the input and output frequencies or 
frequency ranges is given by 

30 fv=f^UfY,_, (4) 

where f^ denotes the range of frequencies of the output^ and 
f^ and f^_^ denote the ranges of frequencies produced by the 
A/th-order and ) th-order nonlinearit ieg , and 

35 

14 
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i -I 



Jc=0 • 



when 
when 



nb 



(a + b) 

nb 
(a + b) 



na 



(a + b) 
na 



<1 



> 1 



(a + b) 
n = N and 



N-1 



i = 



where [ . ] relanes to or means take the integer part, 
na 

+1 

(a + b) J 

I,^ = [na - k (a + b) ,nb-k(a-*-b)] for k = 0,,..,i*--ly 
I.. =[0,nb-i'{a + b).], 

and the frequencies of the signal to be processed are in the 
range defined by the interval [a,b] , 



10 Given [a^Jfc?] and the required output frequency range f^/ 

the smallest ISf for the NARX model (1) and (3) which can 
bring aboi:Lt th^ specified frequency domain energy 
transformation can be determined from equation 4- 



15 (iv) Map the NARX model with the structure given in (iii) 
into the frequency domain to yield the frequency domain 
description. The frequency domain description is given in 
terms of the Generalised Frequency Response Functions 
(GFRFs) , H^^( jWi,"-vjw^) , n = l,-..,N, which, after this mapping^ 

20 are specified in terms of time or spatial domain model 
parameters , 



The mapping of the NAEOC model ( 1) and ( 3 ) between the 
time or spatial domain and the frequency domain is given by 

25 

1 ^ 
|l-&io(lL)exE(-j (w,+,-v-H.„>lx|r'^'' 

n = l,,„,N (5) 



15 
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Therefore the frequency domain properries of the system can 
be completely defined in terms of the parameters Cpg^ (-) of 
the time or spatial domain description of the system. 

(v) The output frequency response of the non-linear system 
(1) and (3) is given by 

a-1 



where 
with 



Y,(jw)= ^ Z, ' fH„(jw,,,..,jwjnu(jw,)da, (7) 



J{-)da-„ 



15 denoting an integration over the nth-dimensional hyper-plane 

W,+,-",+V7^ = w 

Based on this relationship, the parameters in 
(j^lr ' - • ^j^n> f^=l^ ' ' ^ which, due to the mapping 

20 performed in (iv) , are the same parameters as those in the 
time or spatial domain model are determined- This step 
enables the shape of the output frequency spectrum Y (jw) to 
be defined which in turn ensures that the specrrum 
approaches the specified output frequency spectrum as 
25 closely as possible. 

Different design specifications can lead to different 
implementations of corresponding designs. 



(v.l) Firstly, given knowledge of the input spectrum 

30 U(jw) and the required output spectrum Y-^ (jw) . Substituting 
(5) and (7) into (6) yields 
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1 ^ ^ r- n ... llx 



10 



Equation (8) enables the parameters associated with the 
time or spatial domain NARX model, 

and 

CIO (^V ' ^1^^' ' ' * '^1, 

to be derermined as follows to implement the required 
design: 

1) Based upon the equation 



15 



determine parameters 

using a least squares routine to make the right hand side of 
equation (9) approach the specified output spectrum as 
20 closely as possible ♦ 

The first terra on the right hand sid© of equation (8) 

1 



l"Zc,o(li)exp (-jwl,)| 



25 



is omitted from (9) - The omitted term represents linear 
output torms in the time or spatial domain realisation of 

17 



SUBSTITUTE SHEET (RULE 26) 



30-08-00 11:55 Fron:HARRISON GODDARD FOOTE +441142730312 T-663 P. 25/99 Job-687 



10 



20 



W0 99/4S644 PCT/GB09/005SO 

the nonlinear system and these may nor be needed to achieve 
the design at this step, hence they are omitted from (9) . 

2) In order to augment the performance of a filter designed 
as above, it may be desirable to also design a suitable 
linear filter H{jw) to improve the approximation to Y* (jV) 
obtained in 1) above such that 

can acr^ieve a better approximation to Y* {jw) , As part of 
rhis linear design the parameters ciQ(i]_), Ij^ ^l,..,,Ki 
which ware omiTir^d from (8) to get (9), can be obtained from 
the parameters of the linear filter. 



Design 1 hereafter illustrates the design of a non- 
15 linear system using this first case. 



(V.2) Secondly, given the inp^t spectrum U(jv/), and a 

specified bound for the magnitude of the required output 
spectrum, Y^* (w) . 



A bound Y^(w) for the magnitude of che output spect 
Y(jw) of the NARX model (1) and (3) can be expressed as 



rum 



n 

according to the result in Billings, S.A. and Lang, Zi- 
Qiang, 1996, A bound for the magnitude characteristics of 
nonlinear output frequency response functions. Part 1: 
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Analysis and computation. Int. J, Control, Vol.65, pp309- 
328/ where 



5 denotes the n-dimensional convolution integration for the 
magnitude characteristic of the input specrrum and 

represents a bound for the GFRFs magnitude 

10 with wi, . , . , Wn satisfying the constraint - - . , -^Wjri - 

For the NARX model (1) and (3), 

can be evaluated as follows 



15 K( jw,,'"; jw^f = 



1- Z^io(^i)®^P Mwl,) 
Combining (10) and (11) yields 



i 



(11) 



1- 2cio{li)exp (-:)wl,) 



(12) 



20 



where 

25 Equation (11) enables 

= Zk„(i,,-,ij| 

and cio (Ii)/ li=l , - . . / iCi to be determined for shapxng the 
bound yS(w) for Y(jw) in order to make this bound approach 
(w) . The procedure which can be used to achieve this is 
30 as below- 
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1) Based upon the equation 

use a Isast squares routine to make the right hand side of 
5 the above equation approach Y^* {w) especially over the 
frequencies or frequency range to which the required energy 
transformation needs to be implemented. The coefficients 
n = L,--,N, in equation (13) must be constrained to be 
positive since is. the result of the summation of the 

10 modulus of the coefficients con(J-l^ - • ■ ^ ^n> ' 

Ij^l , ■ • ' / T^u / • • • f^nT^ / ■ • < r^n . 

The first teonti on the right hand side of equation (12) 
1 



15 



20 



1- ^ciodi) (-jwij 

is omitted from (13) . The omitted term represents linear 
output te^rms in the time or spatial domain realisation. 
These omitted terms may not be needed to achieve the design 
at this step, hence they are omitted from (13) . 

2) If necessary, the approximation to yS*(w) in 1) above 



can be supplemented using a linear filter with a magnitude 
25 characteristic lH(jw)| such that 

provides a better approximation to the specified bound and 
as a result ciodl). Ii=l, . • ■ , i^l, which were omitted from 
30 (12) to get (13), can be oi^tained from the linear filter 
parameters . 
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Design 2 hereafter illustrates the detailed procedure 
of the' above and several examples of the design. 



(V,3) Thirdly, there are many practical situations which 

5 should be dealt with on an individual basis. There follows 
examples of two such situations, 

(a) Referring to figure 3 there is shown an input 
signal having a spectrxlm U(jw) 300 which comprises .a portion 
10 302 of interest, between frequencies a and e, and an portion 
304, between frequencies e and b, ro be translated to 
another frequency range 306 defined by frequencies f and 2b 
while retaining nhe portion of interest 302 within che 
output signal 3QS . 

15 

In order to realise the energy transformation shown in 
figure 3, a non-linear system 400 can be constructed as 
illustrated in figure 4 which comprises means 402 , 404 and 
406 for implementing the following components 

20 

Hiijw), H2(jwi,jW2)f and H{jw) . 

Hj^Cjw) 402 and H<jw) 406 can b© implemented readily using 
classical linear band pass filters, while ^2 < J r J ^ 404 
can be constructed in the time or spatial domain as shown in 
25 the equation below 

y2(^)= Z CQ2(l,;l2)n^<l^-li) 

with the parameters, c^2(li'l2) / = l/'-^K^^l^ = l.-'^Kj being 
determined to produce the signal y^O^:) with a required 
30 frequency characteristic. Each of the components 402, 4 04 
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and 406 have corresponding frequency responses 408, 410 and 
412. Consequently, the whole non-linear system can be 
realised as a non-linear time or spatial domain filter as 

.iii^u()c)+^4^ t c„,(i„i.)riu(k-i,) 

where 

are the backward shift operator descriptions of the linear 

filters which have the frequency response functions H-i(jw) 
and HCjw;, respectively. 



15 



20 



The equation foir y(k) cmn be fur-char writcen as 
H,„(q-^)H„(q-')y(k) = H^(q-hH„(q-^)u(k> + H,(q-MH„{q"') J^Co^di,!.)!!^ ( ^i) 



which is clearly a NARX model that can be described by 
equations (1) and (3) . 



Altbough the above shows energy transformation from a 
frequency band to a higher frequency band, energy can 
equally well be transferred from one frequency band to a 
lower frequency band. 
25 (b) If the objective of the energy transformation and 

hence tbe desired non-linear system is only , to distribute 
energy of the signal ro be processed over a wider frequency 
band without energy amplification then a simpler model may 
be sufficient. Referring to figure 5, there is shown 
30 schematically an input signal 500 in the frequency domain 
comprising energy between frequencies a and b. The desired 
output frequency spectrum 5 02 comprises two portions, a 
lower frequency portion 504 and a higher frequency portion 
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506. It will be appreciated that the energy of th.e input 

signal 500 is to be spread over the two frequency ranges 504 
and 506. 



A quadratic filter, for example, 
y(k)=a (k) 

can be designed to redistribute energy of the original 
signal u (k) , with freq[uency components over the frequency 
band [a,bl, to the new ranges [0,b-a] and [2a, 2b] without 
energy amplification provided an appropriate a is selected 
in the design process described above. 



<vi) The final step in the design process is to 

materially realise, that is, to physically realise the 
designed filter using appropriate software or hardware or 
combination of software and hardware. 



Although the present invention has been described above 
] with reference to a NARX model, it will be appreciated that 
the present invention is not limited thereto. The method 
and realisation of non-linear systeias having pre- 
detorminaJale frequency or energy transfer characteristics 
can equally well be utilised using other forms of 
25 descriptions of non-linear systems or models where there 
exists a requirement to transform or transfer energy at one 
frequency or band of frequencies to energy at another 
frequency or band of frequencies. 



The present invention can be used to realise energy 
transformations over frequencies using a nonlinear system or 
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to modify energy rrans formation of an existing linea-x or 
non- linear system, 



Furrhermcre, the present invention can be applied or 
5 utilised in the field of design and realisation of 
electronic circuits or filters. The energy in the inpur 
signal at a particular frequency or band of frequencies is 
transferred to desired frequency bands. Similarly, in 
mechanical systems, t)ie addition of non-linear mechanisms 
10 could transfer the energy of a vibration at an undesirable 
frequency to some other frequency. The present invenrion 
may also find application in the field of fluid mechanics, 
for ejcample/ in the affects of flow around objects {e,g, oil 
platform legs), noise in ducting and pipe flow systems. 

15 

Alternatively, the modifications which are required to 
be effected to a known linear or non-linear system, for 
example, a mechanical system, in order to bring about a 
particular frequency distribution of energy can be 
20 determined using the present invention and then the linear 
or non-linear system can be so modified. 

XI , EXAMPLES 
25 II -1 DESIGH 1 

Design No-1 shows an example of how the energy of an 
input signal having predetermined frequency components can 
be transferred to other frequencies. 

Consider digitally filtering an input signal 
u ( t ) - cost + cos2t , ^^^^ 

24 
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wKarain the sampling period is T = 1/100 s . 

The first step is to determine the frequency spectrum 
of the signal to be processed- The frequency spectrum of 
5 the signal to be processed comprises input frequencies 
w^^ - 1 and =^2 

The second step is to specify the output frequency 
characteristics of the filter. Two different filtering 
10 problems will be considered for this example. 

The specification for the first problem is to transfer 
the energy in u(t) to the output frequency — 0 and the 

specification for the second problem is to transfer the 
15 energy in u(t) to the output frequency w^^=4 . 

Since the sampling period is T = 1/100 s, rhe digital 
input to the filter is 
1 2 

u(k) = cos k + cos k for k=0,l,,,, , (15) 

100 100 

20 the normalised input frequencies are therefore 

w^, =1/100 and w^^ =2/100, 

and the required normalised output frequencies are 

w^^=0 for the first filtering problem and =4/100 for the 

second filtering problem. 



For this example, the output frequencies produced by 
the nth-order nonlinearity of a non-linear filter are 
distributed uniformly in 
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>0 



nb f na ] 

hen <i 

(a + b) I (a + b) J 

nb r n a T 

a + b) "L (a >b) J " ^ 



PCT/GB99/00550 



(16) 



wh e n 



of X, and 



100^ 



where a = -— -/ ^ ^ means -co take the integer part 

+ 1 , 



1 = 



na 



(a + b) 



I. =[na- j (a + b) , nb-j (a + b)] for j = 0, ,..,1'-! , 
I.. =[o,rLb-i'(a-i-b)], 

with the difference between any two neighbouring frequencies 

2 1 1 
being ^ " ^qq ^ ^qq - 3_qq' 

For n-1^ it can be evaluated from the above equations 

(17) 



that 



J J- -i-i 

• Lioo'iooJ 



and the corresponding output frequencies are 

_1 2_ 

IQO ' 100 

For n=2, it can be similarly obtained that 



2 


4 










.100' 


100, 





0, 



100 100 



2 4 
100' 100 



lOOj 



and the corresponding output frequencies are 

I 'lOO'lOO'lOO'lOOj 

Thieirefore^ a NARX model of u.p to second order 
nonlinearity will be sufficient to realise the energy 
transformations required by the filtering example thereby 
addressing the third step in the design process. 

According to the above analysis, select a NARX model of 
the forici 
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as the basic structure for the non-linear filter and take 
K2 = l for simplicity. The parameters K^. c^gd) ,..*,c^q(KJ and 
CojCkj^/kj) t kj==:0,l and kijsO,!, then need to be determined to 
completely specify the design. 



10 



It 15 



20 



In order to d^arive the procedures for determining these 
parameters, consider the frequency domain characteristics of 
the filter model (18) . According to J. C- Peyton Jones and 
S.A.Billings, Recursive Algorithm for Computing the 
Frequency Response of a Class of Non-linear Difference 
Equation Models, Int. J. Control, 1389, vol.50, No. 5, 1925- 
1940, the generalised frequency response functions of this 
filter model ar^ 

H,{ jw)-0 



i * ^ - 



1 - 2]=io( J^^i) e^p[- ^(wi + W2)ki] 



(19) 



for n>3 



The output frequency response of the filter 
under the input 

— — e ■ / 



(18) 



u(k)=cos k + cos k=: T" 

100 100 ,..tl.o 2 

with K=2, A(w.) = l, Ws^ = j?/^QQ, w_j^=-w^, i = ±l.±2, can be 



(20) 



2S 



wra-tten as 



1^ 

Y(jw) = 2Y„( jw> = YjC jw> 



\ ZA(Wi,)A(w,JH5,{jWi^,j*^^) for w->0 



7 ZA(Wi,)A(Wi^)Hj(jw,,,jWiJ 



30 



for w = 0 
(21) 
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Where i^.i^ e{-2 -l,+l,+2} , Y(jw) is relared to the output 
spectrum Y(jw) by 

[2Y(jw) for w>0 

and. similarly, Y,(jw) is related to the nth-order output 
5 spectrum Y^(jw) by 

r2Y^(jw) for w>0 

This is a" specific form of the general expression for output 
frequency responses of non-linear systems which are g^ven by 

Y(jw) = X^(:j^^ ^^^^ 
10 where 

Y„(jw) = ;^ K^^-'- jw„)fla(jw,)da„ (23) 

with 

J(-)cio-, 

denoTing an integration over the nth-dimensional hyper-plane 
w^+,...,+w„ = w and N being the maximum order of the dominant 
system nonlinearities . 
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l-Zc,e{kOe^-jwk,]^'=-=- 



=3 



10 



= H ( j w)i; Xc,,( k,,k,) f (w.k^.k^) for w > 0 
and 

f(w,k.,k^) ^ ^ 

)c,<iO)si=0 



where 
H( jw)= 



l-2]c;Lo(ki) exp[-jw ki] 



f (w,k„k,) = ^ XA(Wi,)A(w,^)exp[-j (Wik, + Wi^k,)] 



Moreover denoting 

Z Z^oz^ki^k,) f (w,k,,k2) for w > 0 



Y ( jw) = ^ 



for w=0 



k.-OJc,=0 

gives 

15 Y(jw) = H(jw)7(jw) . w^O 



(24) 



(25) 



(26) 



(27) 



(28) 



(29) 



20 



In view of the fact that H(3w) is the frequency 
response function of a classical linear filter and Y(jw) is 
a linear function oC the filter parameters Co2(J«i,kj) , 
k, =0,1 and k2 = 0,l, the procedures for determining the 
parameters of the non-linear filter with the given design 
requirements and the structure (18) are given as : 
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(a) From Che design requirements, determine the desired 
output frequency characteristic y'(jw) and choose the 
parameters c^A^'K) ' = 0, 1 and = 0, 1, appropriately to 
make Y<jw) approximate Y'(jw) as well as possible. 

(b) Examine the filtering effect of 
y (k) = i;i;c„(ki;c,)u{k-k,)u(k-k,), (30) 

Where a^^(k,,\c.J , lc,=0.,l . k^^O,!, are the results obtained 
in the procedure (a) . If the effect is acceptable, then 
choose H(jw)=I so thar the filter parameters 
Cio( 3-) = c,o(2) =^ c^^(K,) = 0 ; 

otherwise design the classical linear filter H(jw) to make 
H(jw)Y(jw) satisfy the requirements for the output frequency 
characteristics and obtain the filter parameters 
K,, c,,(l) ,c,o(2) ,.».c,o(K,) at the same time. 

Therefore, in order to address the first problem ro 
transfer energy from u(t), w^, = 1 and w,, ^ 2 , to the output 
frequency w^^ =0 , take 

20 y^jO) = l, Y*{jwj = 0, ^i=Y^' 1-^1,2,3,4. 

and for the second problem to transfer energy from u(t), 
W3^=l and w^5=2, to the output frequency w^<j=4, take 

= Y'(jwj = 0, w,=Y~, i-1,2,3,0, 

25 The filter parameters c^^{k^,)c^) , ki=0,l , k2 = 0,l, can then 
be determined through the group equations 
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X 1 



Ref Y ( j 0 )] = 2^ 2. CojC l«i ' 1^2) 



1 1 



Ini[r(jO)]=^£2=02(l^iAj) r^-^ 



(31) 



by the least square's method. In (31) t^<-) and ,) 
represent the real and imaginary parts of f {.) . 



Rewrite (31) as 



Y = X5 



(32) 
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where 
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Re[Y^jO)],..-,Re^r(j^)|lm[Y'(jO)],...,^ 



(33) 
(34) 



X ^ 



f 0 , 0 , 0) 



f"(0. 0, 1) 



f ^( 



100 

f 't 0 . 0 , 0 ) 



.0,0), f ^( 



4 



100 

A_ 
2 
2 

1 

2 
X 

0_ 

2 

0 
Q 



10 0 



100 



2 C Q iS 



c o 5 



LOO 

2 

10 0 
3 

10 0 
_4 

10 0 



- s a- n 



0 - 2 3 i n 



10 0 

2 

10 0 
J 

100 
X 0 0 



I - - i ~ 

2 1 
cos -— + c o s — — 
10 0 10 0 

1 

Cos 

10 0 
1 2 • 

cos , ^ ^ c o s T-T-r- 
10 0 10 0 

2 

COS 

10 0 
i 

' s t n ^ ^ ^ 

Z __ 1 0 Q 
2 

1 2 

sin , ^ ^ - 5 1 r\ 

10 0 10 0 

. I 
- E J. n — ~ 
LOO 

. L . 2 

X 0 0 10 0 

-sin 7-— ■ 

LOO 



(35) 



Notice that 9 can he written in the form of (34) due to the 
fact that 

10 f.(w,0,l)=r f (w,l,0} . (36) 

Therefore, the filter parameters 0 for the first 
filtering problem to transfer energy from u(t), 

= 1 and = 2 , to the output frequency w^^ = 0 can be 
15 obtained as 



4 ^(X^)''>rY^ 
where 

^ 5 -!T 



1,0,"', 0,0,--, 0 



(37) 



(38) 
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and the parameters 6 for the second filtering problem to 
transfer energy from u{t), w,x=l and w^, ^2, to the output 
frequency w^^ =4 can be obtained as 

(39) 
(40) 

(41) 



4 =(X^)''X% 
where 

4 s 

Y, = 



The results of computing (37) and (39) are 



and 
A = 



C^or(0, 0) 
C^zd, 1) 

C^2(0,l)+C^2(l,0) 

C-o2(l, 1) 

C'fl2(0,l) + C-02(1, 0) 



1187 
1187 
-2373.8 

-1206.2 
-1206.2 
2413.2 



(42) 



respectively. 

Under the inpat of (20), the power spectral densities 
of the input and output of the non-linear filter 



(43) 



20 



= c^2(0,0)u^(k) + c^.(l»l)uHk - 1) + [c^2(l,0) + c^2(0,l)]u(k - l)u(k) 

which is initially designed to address the first filtering 
problem above, are shown in figure 6, and the power spectral 
densities of the input and output of the non-linear filter 
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y,( k) = 2 ^1'^^) u { k ^ u ( k - 

= cV(0,0)u^'(k)+c='o2(l,l)u^(k-l) + [c'o2(l,0) + £^2(Oa)lu(lc-l)u(k) 

(44) 

which is initially designed to address the second filtering 
5 problem above, are shown in figure 7 . 

Further improvement to the performances of the filters 
(43) and (44) may be possible. Therefore, a linear filter, 
H(jw), is designed in order to further improve th« filter 
10 performances. 

To improve the performance of the filter (43) for the 
first filtering problem, H(jw) is designed to be a fifth 
order low-pass type 1 Chebyshev filter with cut off 
frequency O.S rad/sec and 0.5 dB of ripple in the pass-band 
to ensure a satisfactory frequency response over the pass 
band. The result is 

b^l) + b^(2) 2"^+---+b^6) z'M 

n, 0174 + 0. 08S3z-^ 4.0. 18122-^ +0.1652Z-' +0.09332-" +0.0159z 



25 



= " 1 + 4 994l3-^-9.97652-'+9.9648z-'-4.9766z-^4-0.9942z-^ 

(45) 

To improve the performance of the filter (44) for the 
second problem, H(jw) is designed to be a fifth order high- 
pass type 1 Chebyshev filter with cut off frequency 3.9 
rad/sec and 0-5 dB of ripple in the pass band for the same 
purpose as in the first problem case. The result is 



b'( l) + b^2)2"'^-Hb'(6) 2~' 
H.(jw)= i_a^(2)z-^ — -a^(6)z-^ 

0.9218-4, S088z-^ +9 . 2175z-' -9 . ZlVSz"^ +4 . 6088^-" -0 ■ 92182-'' 



l + 4.a381z-^-9.3635z-^+9.0613z-'-4.3846z^+0.8486z- 



(46) 



30 



The purpose of the additional linear filter is to 
attenuate unwanted frequency components in the outputs of 
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the filters (43) and (44) for the above two filtering 
problems respectively to make the output of the additional 
filter satisfy the corresponding design requirement. 

5 It will be appreciated that the filter parameters 

K^, Cio(l) /••■,Cjo(Ki) , associated with the expression 

|^-Z<=io<J«i)exp[-jwk,]| in H(jw) can be obtained as a result 

of dividing the denominator of H(jw) by the numerator of 
H(iw). The specific H{jw) is given by H^(jw) andH,(jw) in 
10 equations (45) and (46) for the two filtering problems 
respectively. ^ ^ 

The general description for the nonlinear filters 
15 designed as above is 



y(lc) = H(q"^) y (Jc) 



= Z tc^.lk.^k^) u ( k - k,)u (k - kj) = 2 £c,2(k^,k,) qr^'^q-^'u ( k) ( 47 ) 



where 



20 H(q-) =(l-i;c,o(k,)q-') , (48) 



and q-* , q-' and q'^ denote the backward shift operators . 
Another expression in the time domain for (47) is 

y{k)=H-{q-)[ i:|:c„,(k„k,)qr'q-= Ju(k) (49) 



25 Therefore, embodiments of the non-linear filters which have 
been designed can be realised in a manner as shown in figure 
8 or more specifically as shown figure 9. 



It will be appreciated that in figure 8 the two 
30 components 800 and 802 are represented by 

Gx(qrSqr)= S tcjk,,k,)q:'''q,-" 
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and 



b (l) + b (2) q"'+--"fb (6)q'' 



For the first filtering problem in this example 



1 I 



with Co2(k^,k2) *s given by (41) and 

b^l) + b^(2)q-^-H--hb^6)q-^ 
^'^"^ l-a^2)q^^— a^(6)q'^ 

with b^i) 's and a^(i) 's given by (45). 



For the second filtering problem in this example 

:3 with c^^dc.^k.) 's given by (42) and 

^3 ,i b^l) + b"(2)q-'+--"i'b'(6) q"' 

^-^^ l^^-(2)q-^— -an6)q-^ 

J with b^(i) 's and a^<i) 's given by (46) . 

15 Referring to figures 10 and 11, there is shown the 

filtering effects of the filters designed to address the two 
filtering problems. Figure 10 shows the power spectrum 
densities of the output and inpnr of the nonlinear filter 

i: which is finally obtained for the first' filtering problem. 

:1 20 Figure 11 shows the power spectrum densities of the output 
and input of the nonlinear filter which is finally obtained 
for the second filtering problem. The effecrs of the 
filtering in the time domain of the two filters are shown in 
figures 12 and 13 . All the responses indicate that the 
25 fil-cers substantially satisfy the design requirements. 
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II -2 DESIGN 2 

Design No -2 illustrates the detailed procedure and 
several examples for designing a non-linear system for 
transferring tne energy of a signal from a first 
predeterminable frequency or rang© of frequencies to a 
second predeterminable frequency or range of frequencies 
such that the output frequency response of the nonlinear 
system so designed is v^ithin specified bounds. 

11.2,1 Detailed^ Procedure 



(D Given u<c), the signal to be processed in the time or 
LJ spatial domain/ the frequency band [c,d] to which the 

\ji 15 energy of u(t) is to be transferred, and the user 

1=^ specified bound Y*'(w) for the output spectrum Y(jw) over 

[c,dl for the design. 

ry (2) Sample the time or spatial domain signal u{t> with 

i:3 20 sampling interval T to yield a discrete series {u(k)}and 

perform a Fast Fourier Transform (FFT) on the series to 

compute the spectrum U(jw) of u(t) as 

K^^^)=='^"<'(^f')' ° f 

where U^[j o] is the result of the FFT operating on {u(k)} 
25 and M is the length of the data used to perform the FFT. 

M is taken as an even number for convenience. 

(3) Evaluate the range [a,b] of frequencies in u(t) as 

2^ , 2:t ^ 

b = 1,., a = 1^ 

MT ^ MT 
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where 1^ is an integer such that 



PCT/GB99/00S50 



and 1» is an integer such that 

ofj— 0>0.05, for 1 e{o,...,(l. -d} 

(4) The relationship between the bound of the output 
spectrum Y*(w) , the coefficients of the NARX model 



y(k) = Sy,(k)' 



t-t Con(l.-'Uflu(k-i,) for n>2 
f;cio(l^)y(k-L) + i;c„(i,)u(k-l,) for a=l 



and the spectrum U(jw> is given by 



1- S^-.oUi) exp (-jwl^) 



where 

are^arameters associated with the NARX model parameters 

Kn.CoJl,,-.!,), i,=l.-^K,,-,l,-l,-,K„, for n^N^^-.N, 
lu|*-"*|u( jw)l denotes the n-dimensional convolution 

n 

integration for the magnitude lu(jw)|of the spectrum 
U{3w), which is defined by 
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| 0|*-'|u(jw) h E;-Cl"(3wj|-|cJ[j (w-w,-,-,-w„..) ]idw,...dw„., 

n 

and No=l when Ehe NARX model involves nonlinear terms 
from order 1 to N . 



10 



15 



20 



25 



Based upon this expression, zhe structure 
parameters N and and the NARX model parameters are 
determined as below. 

(i) Evaluate 

i -1 



when 
when 



nh 
(a + b) 
nb 

(a-hb) 



na 



(a + b) 
na 



<1 
>1 



where [ sc ] denotes zh& integer part of x, 
+ 1 



L (a + b) 



li ^fna-Ka + b) ,nb-i(a+b)], for i = 0,---,i'-l 

I^. ^[o,nb^i'(a+b)] 
for n=l,2,... until a value of n is reached such that 
part of the specified output frequency range [c,d] 
falls into f^ . This value of n is used as the value 



of N^. 

(ii) Evaluate 

^or n=2,3,... until a value of n is reached such 
that the frequency range [c,d] falls completely 
within the corresponding . This value of n is 
caken as the value of N . 

(iii) Calculate 

|u|*.-.*|u(jw)| 
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to yield 

5^HU{^^ for i = 0,.-.,M/2 

n 

using the algorithm 



for n = No,-'-vN , where Conv ( . ) denotes the 

convolution operation and S(.) and 5(.) represent 
the intermediate results of this algorithm. 



(iV) Based on the (i^-i^+l) equations 



,i, +!,•••, ia 



(X) 



Where i.=rou.{^], i. = rou.d[f^] , ... ....a 

means to take the integer nearest co x, use a least 
squares routine to compute 

under the conatraint that the results must "be 
positive, and then select the NARX model parameters 

for n:rNo,--,N 

"tmder the constraints on the summation of the 
modulus of the coefficients given by 



Cn-Z-iK,{l,r-,lJ, 



_. - , - n = Nor-,N 

(V) If necessary, design a classical linear filter, for 
example, a band pass filter which ideally allows the 
frequency respons-e to be unity over the frequency 
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band [c,dl and zero beyond to yield the linear 
frequency characteristic 

1 

fC, 

l-£c,o(lt)exp (-jwl,) 
_ ^i"^ 

and therefore . determine the parameters associated 
5 with K^, Cjg{l^), Ij^ = l,"-,Kj . Otherwise, all of the 

parameters of c^o( .) can be Tiaken as zero to yield a 
model having np regression terms associated with the 
output . 

(5) Construct a NARX model as shown in figure (14) using the 
10 results obtained in the above (iv) and (v) . The 

nonlinear system illustrated in figure 14 comprises a 
nonlinaar part 1400 and a linear part 1402. It will be 
appreciated that in figure 14 

I q^{i..-- A)fiu()c-i,)=2:-i: c^(i,,".gnu(k-i,) 

15 

II. 2. 2 Three Specific Exainples 
Example 1 

20 This example illustrates a further implementation or 

design of a nonlinear system following the above derailed 
procedure . 
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(1) The signal to be processed is given by 
, ^ 1 sin a t -sin t 

with a = 3. 3, ^=1, and ^ 1 . 6 . The frequency spectrum 
U(jw) of the signal is shovm in figure 15 indicating 
that the real input frequency range is [l,3.3]. The 
requirement for the design is to transfer energy of the 
original signal to the frequency band [c,d]= [5 . 6, 7 . 6] 
with the bound ^ on the output spectrum magnitude 
specified to be Y'**(w)=:l«6 over this frequency band. 

\2). Sample u(t) with sampling interval T = 0.01 sec to produce 

1 sin QkT-sin ^ kT ^ , ^ 1 sin 3.3^^0. Glk-sin 0,01 k 

u(K) = 2M^^-- ^ = 2x 1. 6x — X 

2^ kT . 2;r 0.01k 

k--1999,".,0,---,2000 
and perform a Fast Fourier Transform (FFT) on this 
15 series (M=4Q0O) to cort^ute 

^^(^^^)"^^(^7^^1 l--1999,.-, 0,..-, 2000 



4000 

and rhen to yield 



1=^1999,...; 0,-'v 2000 



the result of which, in the nonnegative frequency range, 
is shown in figure 16, 



"iffotice the difference between the real spectrum of 
u(t) in figure 15 and the computed spectrum in figure 
16. The differences are due to the errors caused by the 
25 TFT operation. The design should and will be performed 

based upon the computed spectrum to lead to more 
practical results. 
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<3> Evaluate th. f„^,„,, ^^^^ 
computed spectrum giving 

a = 0.6283 b = 3.7699 

(4) Design the system structure and parameters 
(i) Determination of Nq . 

Clearly, the output frequency range contributed by 
the linear part when the input frequencies are within 
[a,b] = [0.6283, 3.7699] is 

=[a,b] = [0.6253, 3.7699] 
The frequency range f,^ produced by the .^cond 
-■ . order-- nonlinearity in this case is obtained as 

follows. 

Since n = 2. 



nb 

15 (a+fa) 



20 



[na 
(a+fa) 



2x3.7699 



2x0.5283 



and 



So 



(3.7699+0.6283)' L (3.7699+0. S283) 

=1.7143-[ 0.2857 ]=1.7143-0>1 



[ na 
(a+b). 



+1 = 



2x0.6283 
. 3.7699+0.6283 



j+l=[ 0.2857 ]+l-0 + l=.l 



^ ^ '{y™~^ (a+b||j[0,rf3-i'(a+b)| 

'f«^0,rl>-(a+b)l={2x0.6283, 2x3.769^0, 2x3.76»-<0.S2S3+3.7699)j 
= [1.2566, 7.S398JU[0, 3.1416] = [o, 7.5398] 
f,, thereby obtained contains pare or the specified 
output frequency range [c,d] = [5.6, 7.6]. So, N, 
aetermmed to be = 2 . 

(ii) Determination of N . 
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Evaluating f,=f^(Jf._for yields 

^U=4U£r,=[0, 7.S398]U[0.6283, 3.7699] = [o, 7.5398] 

To evaluate t,U=L{jt,,^^ calculate first. In 

this case ' 

,r »a 1_ 3x3.7g99 r 3x0.6263 ' 
(a+b) L (a+b) J~ (3.7599+0.6283)1 (3.7699+0. S283) . 

=2.5714-[ 0.4286 ]=2.5714-0>1 



i = 
So 



tia 1 r 3x0.6283 "I . 
L(a+b)J*^-i 3.7699+0.6283 J^^'^ ^'^^^^ ] + l-0+l = l 



^. =\J^i =IoUli =[na,nb|J[0,nb-(a+b)l 

= [3x0.6283, 3x3.7699]U[0, 3x3.7699-(0.S283+3.7S99)] 
=[1.8848, 11.3097]U[0, 6.9115]=[0, 11.3097] 
Therefore 

^U=fr,Uf«==[0/ 7.5398]U[0, 11.3097] = [0, 11.3097] 

^yUi thereby obtained includes the whole specified 

output frequency range [5.6, 7.6]. Af is therefore 
determined to be N = 3 . 

(iii) calculate |uh-*|u ( jw)| for n = N, = 2 and n = N = 3 , 

n 

respectively to yield 

I^^^^U(ja^j/MIj={I^^^D(jarj/4000xO.Olj i=0,. -,400(72, n=2 and 3 
The results are shovm in figure 17. 

(ivl-fiased on the (i,-i.+l) equations 

Y«-(^ i/2000x0.01) = l.6 = ^C, |D|.|u(j;ri/2 000x0. 01)1 
+ |aH0|*|u(j/r i/2000x0.0l)| 

i = ^c'-^c*-!'""' 1(1-1/ id 

with 
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= round[cMT/2n-] = r ouiid[5 .6x4000x0.0 1/2 xtt] = 36 
= r ound[dMT/2;r] = round[7 ,6x4000x0.0 1/2 x;r] = 48 
use a least squares routine under the constraint of 
nonnegative solutions to compute and C3 , that is, 
5 to determine and C3 , under the constraints of 

C^ZO and C^ZO, zo minimises ttie following 
expression 

X l-S-r-Q M^tijTr iy2000x0.0]^|-— W^l^*|i:(j;r 1/2000x0.01)1 

The results obrained are 
10 ' • - C.^O and Cj =3. 8367 

(v) Design, optionaily/ a linear Batcerworth band pass 
filter to attenuate the frequency components beyond 
the frequency band [c, d] = [5.6, 7.6] to yield the 
linear frequency characteristic 



\5 



10-^f0,098 6-0.1972q'' 4-0. 098 Sq"") 
i ^ — i \q- Q 

l-3.9633q-' +S . 8988q-' -3 . 9076q-^ +0.9721q'' ' 
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(5) Construct: a NARX model as shown in figure 14 with 

N, = 2, M = 3, K,=K,-1, c,,(l,l) = 0, c,3(l,l,l) = 3.83S7; 
chat iS/ 

^ 1,-1 i-i "1 

fxf;q„(i,,i„i,)nu(k-i,) 

L 1 



= ZZ =02(1^1011^ (ic-i,)+ 



and 



=<^(lA)u'(k-l)+qj3(l,l,l)u'(k-l)=0xu-(k-l)+3,8367u^k-l)=3 

P ^ Y lCr^(0. 0986-0. 1972q"+0.0986q"') 

|l-2;ciJl,)q" = l-3.9633q-'+S.a988q"-3.9Q76cf'+0.9721q^ 

which determines the parameters associated with the NARX 
10 model parameters K, and c^od^) , l^==lr"/Ki, 



The output frequency response under the given inpui: is 
shown in figure 18 indicating i:hat the energy has been 
transferred to the specified frequency band [c, d]-[5.6, 7.6] 
15 with the magnitude of the response below the specified bound 
1.6. . . - 

The frequency response of the above design is examined 
for other input signals below. 
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In thd first case, consider 

2M^ r (a-f b)t 

u(t) = ' — r 2co5 cosbt-Gosa t 

;r(b-a)t"L 2 J 

where a, b, and are defined as above. The frequency 

spectrum of the signal is shown in figure 19. The frequency 

5 range is clearly the same as that of the signal having the 

spectrum given in figure 15 and the magnitude of che 

spectrum also satisfies the condition that 

lu(jw)|<M,=1.6 . 
This implies that the frequency response of the designed 

10 system to this u{tl should in theory also transfer energy 
into the frequency band [c, d] = [5.6, 7.6] with the output 
magnitude frequency response being less than Y'''(w)==1.6 over 
this frequency band. Figure 20 shows this frequency 
response and indicates that the actual result is consistent 

15 with the theoretical predictions. 



For the second case, uCt) was taken as a random 
process with the frequency spectrum given in figure 21. The 
frequency spectrum is substantially within the frequency 
20 range [l, 3,3] with a magnitude of less than Therefore, 
the same conclusion should apply for the output magnitude 
frequency response of the designed system to this random 
input. figure 22 shows this response and indicates that the 
energy is transferred to a new frequency band of 

25 substantially [5,6, 7.6]. Note that the magnitude of the 
output spectrum over this frequency band is well below the 
specified bound y^*{w)-.1.6. This is because of the effect of 
the attenuation which is due to intrakernei interference of 
the nonlinear mechanism. 

30 The nonlinear filter which has been designed afiove can 

be represented by the block diagram shown in figure 23. This 
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could be realised electronically by following the approach 
used to realise Design 1 in figure 9. However, for some 
applications the design may need to be realised in 
continuous time. Using the bilinear transformation 

l-h(T/2)s 
'^"l-{T/2)s 

where T=0.01 is the sampling interval, is the delay 

operator, and s is the Laplace Transform operator and 
substituting in tha discrate time design in figure 23 
provides the equivalent - continuous time system shown in 
figure 24. Simulating the system in figure 24 produces 
almost identical responses as the discrete zime system 
response, of figure 18. 

The system in figure 24 could for example be realised 
mechanically as illustrated schematically in figure 25 where 
the cubic device is either a material which exhibits a cubic 
response or is implemented as an actuator which takes ujt) 
as input and produces an actuation output which is 

proportional to the cubic power of the input. 



20 



One possible application of chis design would be in 
vibration isolation. For example it may be required to 
transfer energy from an input frequency range [1,3.3] to the 
frequency range [5.6,7.6]. The new design could be used to 
25 achieve this effect. 

Oth»r much more complicated designs for vibration 
isolation can be achieved based on the present invention. 
The design procedure would be exactly as described above, but 
30 the realisation would involve rne synthesis of dampers, 
dairying materials or actuators with the nonlinear dynamic 
characteristics specified by the designs. 

Example 2 
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Exampid 2 shows an applicarion of the design abou-e to 
the antenuation of signal energy over unwanred frequency 
bands using designed nonlinear effects. 

When using linear structures for the attenuation of 
5 signal energy in a physical system, the attenuated energy is 
usually absorbed by devices such as dampers in mechanical 
systems and resistors in electronic circuits and trans forrp.ed 
to other energy forms such as thermal energy. This may lead 
to undesirable effects and measures, such as using radiaring 
10 devices, sometimes have to be taken to compensate for these 
effects. When a nonlinear system is employed, instead of 
attenuating the signal energy directly as in the linear 
case, the signal energy at a frequency of interest can be 
spread over a wider frequency band and attenuated by means 
15 of the counteractions between different terms which compose 
the output spectrum. This means that; to a certain extent, a 
nonlinear design for signal energy attenuation can reduce 
the requirements for using energy absorption devices and is 
of great benefit in practical applications. 



Another important application would be, for example, in 
the design of the foundations or the modification of the 
characteristics of buildings and structures which are in 
earthquake zones. The objective in such an application would 

25 be to design materials or actuators, tuned as required for 
each structure, which transfer the damaging input energy 
from an ^rthquake to another more acceptable frequency band 
or spread the energy to be within an acceptable bound over a 
desired frequency range. Spreading the energy using the 

30 present design should produce significant reductions in 
earthquake damage. 

(1) Design a nonlinear system to attenuate the energ/ of the 



20 



signal 
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u(t)=- 



2M.. 



a + b 

2cos| — J— t|-cosa t-cosb t 



(2) 



;r(a-b) f 
where a = 3. 3, b = l, M^ = 1.6. 

The spectrum of the signal is evaluated. This is 
implemented by sampling the signal with sampling 
interval T = 0.01 sec to produce 



u(k)=- 



2M.. 



r|^2cos|^^-~kTj ^cosa kT-cos^ kT 



k: = -199.9r"/0,'-,2000 
and perform a Fast Fourier Transform ' (FFT) 'on this 
series. The result of the FFT is Shown In figure 25. 

(3) Evaluate the range [a,b] of frequencies in the signal 
based on the compured spectrum. The evaluation gives 

a-1.0996 b==3.1416 

J!his is because the computed spectrum indicates 

|u(jw)|2:O.0S for w €[l. 0996; 3,1416] 

and 

jU(jw)|<0.05 for other w 

(4) Assume that; as part of the design, output frequency 

range is [c,d]=[o, 7.3] and the required bound over this 
frequency band is Y^'{w) = l. 

(5) Following the same steps for the design of the system 
structure and parameters as in example 1 above, 
Nq, and C^; n = No,*",N were determined as follows. 

(i) Ng 

is determined to be Nq = 1 - This is because 
fj^ =[a;b] = [1.0996; 3.1416]e[0; 7.3]==[c, d] 
where f^^ denotes the output frequency band contributed 

by the system linear part, and part of the selected 
output frequency range falls into the linear' output 
frequency range f^^ . 
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(ii) N 

In this case, it: can be obtained using a=1.0990 and 
b=3.1416 that 

£,,=[2,1992, 6.2a32lU[0, 2.0420] 
f,^=[0, 9.4248] 

Thus, if the maximum nonlinear order is taken to be 2, 
then the output frequency range of the sysrem is 

If the maximum order is taken to be 3, then the output 
frequency range 

f.U=^,Uf..=[0'^ 9.4248] 
Clearly, ^ f^\^^ contains the whole selected output 
frequency range [c,d] = [o, 7 .3], N is therefore determined 
to be N=3. 

(iii) C^, n = l,2,3. 

C^, n = I,2,3. are determined to minimize the 
following expression 

||^i-q|u(j2«i/Mr^^c, M-|a(j2«i/Mr|-^c, NHt3|*|D(j2^ i7Mr)j 

under the constraints of C. >0, i = l,2/3. 

Notice that for this specific example, 
M = 4000 

"Dx40QOxO .01 



TcmtI 
= round — = round 
L 27t J 

fdMTl 
= round = round 



= 0 



2;r 

'7 . 6 x 4000 x0 . 01 



2/r 



:48 



The solution to this minimisation problem is 
^Ci=0, Ci=:2.1932, C3=:6,0550 
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(6) Select the NARX model parameters 

Kn/Co„(l:,-,l,), 1, = I,-,K,,-.1,=1,-',K„, for 

based on the results obtained in (5) as 
Kj^ — ~ — 2 

q„(l,l) = 1.1932, qs(l,2)=<:iB(2,l)=0, qjj(2,2)=-l, 
q„{l,l,I)=3.0550, qi3(2,2,2)=-3, and other 's are zero 
and consequently construct a NARX model as 



ZS cb=(ii-i,)flu(k-i,)+ izz q,3(i.i,,gnu(k-i,) 



10 = ii.m(k-i,)+y.y. c;»(i„ufiu(k-i. i+ tyy cii„i„i,)ni(ic-i,) 

:=c^(l,l)u^ic-l)+<:^(2,2)u^k-2)+c,3(l,^l)u^k-l)+qj3(2,2,2)u'(k-2) 
=^1.1932u'(k-l)-u'(Jc-2) + 3.0550u^{k-l)-3u^(k-2) 

Notice that the selected NARX model parameters 
15 satisfy the relationship 



£ i|<=.2{V^)!-ka, 1^^2(2,2^ =|1.193^^-1| =2.1932«C, 
iililSil\/^/^=i^a.l,lHq3(2,2,2l H3.0554^:^ -6.QS0=q 



and the different signs selected for 

Co2(l,l) and C32(2,2) 

and for 
Co3(l,l,l) and Co3(2,2,2) 

are such as to give effect to the intra-keroel and 

25 inter-kernel interferences, which is to attenuate the 

energy of the input signal. 
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The frequency domain response of the constructed model 
to the sampled series of the input signal is shown in figure 
27. It can be seen chat excellent energy attenuation has 
been achieved by the designed system. It will be 
5 appreciated rhat the input energy in figure 2 6 has been 
spread over the designed frequency hand by the nonlinear 
filter, 



Example 3 



10 



This example shows another application of the present 
invention to: the attenuation of signal energy over unwanted 
frequency bands using designed nonlinear effecrs. The 
example also iiluscraces the effect of the same design on a 
13 different input signal ro demonstrate the effectiveness in 
energy attenuation of the designed syaterci in different 
circumstances . 

(1) Design a nonlinear system to attenuate the energy of the 
signal 

, , 1 sin a t -sin P t 

with a = 3, 3. >3 = 1, and =1.6. 

(2) The spectrum of the signal is evaluated by sampling the 
signal with sampling interval T = 0.01 sec to produce 

1 sin dcT-sin ^ kT ^ 1 sin 3.3x0. Ollc-sin 0,01 k 

u1k)^2M,- ^ — :=2xl.6x— X — 

2ff kT 2ff 0.01k 

25 k = -1999,"v 0,"-, 2000 

and then performing a Fast Fourier Transform (FFT) on 
the obtained time series, Ttie result of the FFT is the 
same as that shown in figure 16. 
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(3) Evaluating the r.ugc (a,b] of frequencies in the signal 
based on the computed spectrum gives 
a = 0.6283 b = 3.7S99 

as the computed spectrum indicates 

jU(jw)l>0.05 for w.e[0.6233, 3.7699] 

and 

lu(jw)|<0.05 for o^l^er w . 

,4, A..u«.e that, a. part- of the design, it is desired that 
the ourput frequency range is [c,dl=:[0' -3] -^d the 
required bound over this frequency range is Y»-{w)=l. 
(5) eollow.ng rha same steps for the design of the system 
structure and parameters as in example 1 above, the 
parameters N„ N, and C„, n = tl,-,N are determined as 
15 follows . 

N, is determined to be No=l due to 

f =fa,bl = f0 .6283, 3.7699]s[0, lQ.3l = [c, d], 
which indicates that part of the selected output 
frequency range falls into the linear output 

frequency range t^^ . 

^'^^ in this example, N is obtained using a=0.6283 and 
b=3.7699. Therefore, 
f,=[0, 7.5398] 
" £,'=(0, 11.3097]. 

Hence, if the maximum nonlinear order is taken to be 
2, the output frequency range of the system is 

If the maximum order is taken to be 3, the output 
frequency range . 
35 f.U=^.U^.=[0' ll-305-'l- 



20 



25 



30 
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As f,|„3 contains the whole selected output frequency 
range [c,d] = [0, 7 . s] , . N, for the design, is determined 
to be N=3. 

5 (iii) C,, n = l,2, 3 

C, n = l,2,3 are determined in such a manner as 
to minimise 

j i-q|u (j2m/Mr^-^c, |t^*jc(j2m/Mr)|-j^c, lc|»it(*|i^j2s- iji^ 

under the constraints of C^^O, i = l,2,3. In this case 
10 alio M-4000 but 



FcMTI fO y 4000 X 0 . 01 
= round|_— J = roand|^ ~ 

rdMTl [10 . 3 x 4000 x 0.0 
i, = round[— j = round^ 



= 0 
1" 



= 66 



The oolution to this minimisation problein is 
C^^Q. C.=0.2928, C,=0,9763 
(6) The NARX model parameters 
15 ^ K„,c^(l,,---,1„), I^=lr",K„,"-,l„=lr-,K^. for n = N„'.-,N, 

are selected based on the results obtained in (5) as 
K, =K2 = K3 =2 

c^(l,l) = 0,.1928, q,,(l,2)=-0.1, qj2(2,l)=0, c^2{2,2) = 0, 
qj3(l,lf 1)=0-S763, c^3(l,2,2) = -0.3, and other c^^(.)'s are zero, 
and consequently a NARX model is constructed 

20 y(k)= t c^{\,-,lM^{^-k) 

i,=i 1,=! i»l 

■ -Co2(l,l)u^k-l) + Co2(l,2)u(k-l)u(lc-2)+c^3(l,l.l)u'(l<:-l) 
-hCo3(l,2,21u(k-l)u^k-2) 

=0.1928u^(k-l)-O.lu(k-l)u(k-2}+0.CT63u^k-l)-0.3u{k-l)u'(k-2) 
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The seiectad MARX modal parameters satisfy the 
relationships 



t|c„(iO| = o = q 



and the different signs selected for 

Cgjd, 1) and Co2(l, 2) 
and for 

c„(l,l,l) and C(,3(l,2,2) 
are in order to give effect to the intra-kernel and 
inter-.kernel interferences, which is to attenuate the 
energy of the input signal. 

The frequency response of the constructed model to the 
input signal specified above ia shown in figure 28 which 
indicates that the required energy attenuation has been 
realised. 

The frequency response of the design above to the input 
20 signal in example 2 gives the result shown in figure 29, 
The nonlinear system design above clearly also works for the 
signal in example 2 in energy attenuation although the model 
was not specially designed for this signal. This is 
reasonable since the magnitude of the spectrixm of the signal 
in example 2 is less than the magnitude of the spectrum of 
the signal in this example over almost ail of the input 
frequency '^'band and over the other frequency bands the 
magnitudes of the spectra of the two signals are all zero. 
This illustrates that the above design is effective not only 
for the input based on which the design is Implemented but 
also for other inputs with magnitude frequency 
characteristics less than the magnitude of the spectrum of 
the considered input. 
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III. FLOWCBARTS 

Referring to figure 30, there is shown a flow chart 
3000 depicting the steps of an embodiment of the present 
5 invention in which the output spectrum is specified over a 
given range of output frequencies . 

The signal to be processed and the desired frequency 
response of tne non-linear system to be designed are input 
10 via steps 3002 to 300^. ' 

At. step' 3002/ a digital input signal {u(k)} and its 
sampling' interval T are to be provided. The range of output 
frequencies [c,d] over which the energy of the input signal 
15 is to be transformed is given in step 3004. The output 
frequency range is specified using beginning and end 
frequencies c and d respectively. The distribution of the 
energy over the output frequency range [cdl is requested or 
specified in step 3006. 

20 

The frequency characteristics of the input signal are 
determined at steps 3008 and 3010. More particularly, the 
frequency components of the digitised input signal, {u (k) } , 
are calculated using a Fast Fourier Transform at step 3008. 
25 The range of frequency components contained within the input 
signal* is determined from the FFT at step 3010. 

Referring to steps 3012 to 3024, the orders of the 

nonlinearities required to realise a desired nonlinear 

30 system and, hence, the energy transformation, are 
calculated. 
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Variables n and are set to one and zero respectively 
at step 3012. The output frequency components resulting from 
Che nth-order of system nonlinearities are determined at 
steps 3014 and 3016. 

A determination is made at step 3018 as to whether or 
not No=0, that is to say, whether or not the smallest order 
of system nonlinearities which makes a contribution to the 
desired energy transformation has been determined. If iJq 
equal to zezo, a determination is made at step 3020 as to 
whether or not part ot the specified output frequency range 
falls within fyn. " determination is negative, 

processing continues at step 3026 at which the value of n is 
Increased by one. However, if the determination is 
positive, the value of No is set to equal n at step 3022 and 
processing continues at step 3026, 

If No is not equal to zero, then a determination is 
made at step 3024 as to whether or not the specified output 
frequency range lies completely within fv = fyn ^-^Yn-l- 
the determination is positive, processing continues with 
step 3027, However, if the determination is negative, the 
value of n is incremented by one at step 3026 and processing 
continues at step 3014, 



25 



30 



Steps 3028 to 3034 determine the values of the lags of 
the nonlinear model for all values of n = Nq, Nq+I/^-'/N and 
determine the parameters of the nonlinear system to be 
designed. 

Step 3036 represents a step for fine tuning of the 
output or frequency response of the designed non-linear 
system. 
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Steps 3038 and 3040 determine whether or not the 
resulting frequency response is sufficient to meet the 
design requirements. If the frequency response of the 
designed filter is acceptable, the discrete version of the 
5 filter is output at step 3042. However, if the designed 
non- linear system does not have an acceprable frequency 
responss, then step 3044 increments the value of by one 
for all n= Nq, No+i/...rN and steps 3030 to 3040 are 
iteratively repeated. 

10 ' - ' 

The determination in step 3040 as to whether or not the 
designed filter is acceptable is made, for example, by 
calculating the difference between the required output 
spectrum and the real output spectrum of the designed system 

15 over the frequency band [c,d] . If the modulus of the 
difference Is below a predeteirminable threshold over all the 
output frequency band [c,d], then the designed nonlinear 
system may be deemed to be acceptable. However, . if the 
modulus of the difference is greater than the threshold at 

20 any frequency over [c,d], then the design is refined. 

Referring to figure 31, chere is shown a flow chart 
3100 for implementing computer code according to a second 
embodiment of the present invention. 

25 

The signal to be processed and the specification for 
the desired bound t:o be imposed upon the output signal 
frequency characteristics is input at steps 3XQ2 to 3106. 

30 At step 3102, a digitised input signal and its sampling 

interval T are to be provided. The range of output 
frequencies [c,d] over which the energy of the input signal 
is to be transformed is specified in step 3104. A bound 
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yB*(„) for th« distribution of the energy over the output 
frequancy band (c,d] is input at step 3106. 

The frequency characteristics of the input signal are 
determined at step 3108 and 3110. More particularly, the 
frequency components of the digitised input signal. (u (k) } , 
are calculated using a Fast Fourier Transform at step 3108. 
The range of frequency components contained within the input 
signal is determined from the FFT at step 3110. 

- Referring to steps 3112 to 3124, the crdera of the 
nonlinearities required to realise a desired nonlinear 
system " and, hence, the energy trans forroation, are 
calculated. 

. variables n and No are set to one and zero respectively 
at step 3112. The frequency coinponents resulting from the 
nth-order of system nonlinearities are determined at steps 
3114 and 3116. 

3 

A determination is made at step 3118 as to whether or 
not No = 0, that is to say, whether or not the smallest 
order of system nonlinearities which contributes to the 
desired energy transformation has been determined. If Np is 
iS equal « zero, a determination is made at step 3120 as to 
whether or not part of the specified output frequency range 
falls within fyn- " ^^^^ determination i= negative, 
processing continues at step 3126 In which the value of n i* 
increased by one. However, if the determination is 
30 positive, the value of N,, is set to equal n at step 3122 and 
processing continues at step 3126. 
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If, at step 3118, it is determined that is not equal 
to zero, then a determination is made at step 3124 as to 
whether or not the specified output frequency range lies 
coircpletely within fy = fyn ^ ^yn-l- determination is 

S positive, processing continues with step 3127. However, if 
the determination is negative, the value of n is incremented 
by one at step 3126 and processing continues at step 3114. 

Steps 3128 to 3134 determine the values for all 

10 values of n = Nq, Noti/-'. wN, which represents- the summation 
of^ the modulus of the values of i:rie parameters of the 
nonlinear " system. 

At step 3136 rhe parameters of a NARX model are 
selected given tha constraints imposed upon the non-linear 
15 system obtained in steps 3128 to 3134. A determination is 
made via steps 3138 and 3140 as to whether or not the 
frequency response beyond the frequency band Cc,d] of the 
designed filter is acceptable. If the frequency response is 
acceptable, the filter design parameters are output at step 
20 3 1 42. However, if the filter characteristics are not 
acceptable at frequencies outside the frequency range [c,d], 
then a conventional filter, H(q~l) , is designed, at step 
3144, in order to reduce or obviate the frequency response 
of the designed filter outside the range of frequencies 
25 [c,d] . Finally, the design is completed at step 3146 by 
combining the designed non-linear and linear filters, if 
any. 



The determination in step 3140 as to whether or not the 
30 frequency response of the designed filter is acceptable 
outside the range of frequencies [c,d] is made, for example, 
by comparing the modulus of the frequency response beyond 
the frequency range [c,dl with a p rede terminable threshold. 
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If the modulus is below the threshold over all the frequency 
range outside [G,d), then the designed nonlinear system may 
be deemed to be airceptabie . However, if the modulus is 
greater than the threshold at any frequency beyond [c,d], 
5 the design is refined. ■ 
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IV. THPgE MORE DESIGNS AHD EXAMPI,E3 



IV. 1 DESIGK OF NONLINEAR FILTERS WITH SPECIFICATIONS FOR 
BOTH THE MRGNITODE AlTD PHASE OF OUTPUT FREQUENCY RESPONSES 

5 

It will be appreciated that the basic principles of the 
present invention can be applied to the design of nonlinear 
filters based on specifications for both the magnitude and 
phase of output frequency responses. The ability to 
10 modulate phase as well as or instead of magnitude is of 
particular importance in telecommunication applications. 

Consider, a filtering problem such that given an input 
spectrum Vijw) over a frequency band [a,bl and a desired 
output spectrum Y^jw) over another frequency band [c,d]; a 
15 filter is required cc be designed so that the output 
frequency response y{jw) can match the desired spectrum 

^'(j^) as closely as possible in terms of both magnitude and 
phase characteristics. The basic principles in Section I can 
be directly applied to realise the design of such a filter. 
20 The procedure to be followed is described below. 

First, a nonlinear filter 

is designed using the hasic principles described in Steps 
^i) — <iv) and (v.l) Part 1 in Section I to produce a 
25 frequency response y,(jv) such that can match ^1*0^^) 

over the specified output frequency range Cc,d] as closely 
as possible in terms of both the magnitude and phase. 

Secondly, if required, design a linear filter with a 
frequency response function H^ijw) such that, Ideally, 

30 ""'^^"""^^tM ^^^'''''^ 
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This can be used to improve rhe result obtained from 

the nonlinear design, so that the frequency response of 
the corresponding output 

5 provides a better match to the deaired spectrum y'ij^) * 

Thirdly, if required, design a linear phase FIR (Finite 
Impulse Response) band pass filter H-,{jw) with the ideal 
magnitude frequency characteristic 

!^^^^"^l = l0 otherwise 
10 and a linear phase over the frequency range. Then construct 
the designed filter using linear filters H^(jw) and H.(jw) 
and nonlinear filter i^u(t)] as shown in figure 32 to yield 
the output frequency response 

15 The second and third steps above follow the design 

principle described in Step (v.l) Part 2 in Section I so as 

to augment the performance of the nonlinear filter 
y,(t) = N[u(t)] designed in the first step. 

Ideally^ ' Y{jw) = H,{jw)Y^_{jw) implies that 



20 \YU^i^ 
and 



0 otherwise 



due to the" linear phase characteristic of H^Uw) where is 
a coefficient which is a function of the order of H^ij^) - 
25 This indicates that the output frequency response of the 
designed filter is ideally the same as the desired response 
over the output frequency range [c,d] except for a linear 
phase difference between the real and the desirecj phase 
response. This is in fact an unavoidable phenomenon if band 
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pass filtering such as the effect of H,(j^) is applied for 
the design. However, this is still an ideal characteristic 
since a linear phase implies that the filter group delay is 
constant, the filtered signal is simply delayed for some 
S time determined by k^, and the wave shape of the processed 
signal is preserved, that is, there is no phase distortion 
in the filter output. 

The results of a specific nonlinear filter design 
obtained using rhe above procedure and based on 
10 specif ica-tions for both the magnitude and phas^ are shown in 
figures 33-33. 

The- given input for this design was produced using a 
white noise sequence uniformly distributed in [0,4] and band 
limited within the frequency range [a,b]=[l,8] under a 
15 sampling interval 0,02 s, The magnitude of the spectrum of 

the given input is shown in figure 33, 

The desired outpur spectrum was chosen to be 
fexp(-500w).j(600w-) ^ ^^^^^y^,,^,,^ 
[0 otherwise 
Figure 33 also shows the comparison between the 
20 magnitude of the output spectrum i'(jt^) of the designed 
nonlinear filter and the magnitude of the desired spectrum 
Y(jw) . 

Figure 34 shows the comparison between the phase angle 
of i'lOw), "1:he output spectrum before linear phase filtering/ 
25 and the phase angle of the desired spectrum Y\jw) . 

Figure 35 shows the phase angle of the applied linear 
phase filter H,(jw) . 

It can be observed from the above that a nonlinear 
filter designed using the basic principles of the present 
30 invention can produce an output frequency response which 
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Figure 35 shows the phase angle of the applied 
linear phase filter H,(jv) . 

It can be observed from the above zhaz a nonlinear 
filter designed using the basic principles of the present 
5 invention can produce an output frequency response which 
satisfies a design specification in terms of both the 
magnitude and phase. 

The discrete time model description of the designed 
filter is given below where the nonlinear part of the 
10 model is the discrete time model description of the 
nonlinear filter 



and the linear pan: of the model is the di5creT:e time 
model description of the linear filter, the frequency 
15 response function of which is 

Nonlinear part of the model: 
20 y(k)= +(3.123e+06) u(k-l) + {-2 . 244e+07) u(k-2) +(6.6026+07) 



+(-l.d27e+08) u(k-4) +(8.961e+07) u(k-5) +(-4.18e+07) 



+(8.176e+06) u(k-7) +(4,235e+09) u(k-l)u(k-l) 
+(-1.772e+10) u(k-l)u(k-2) +(S.897e+09J u(k-L)u(k-3) 
.+(7.213e+09) u (k-l) u (k-4) +(-3.66e+09) u(k-l)u(k-5) 
+ Cjl.869e+08) u(k-l)u(k-6) +C6.736e+07) u (k-1) u (k-7). 
+(-6.777e+08) u(k-2)u(k-2) +(a.003e+101 u(k-2)u(k-3) 
+(-7.57e+10) u{k-2)u(k-4) +(6.023e+09) u(k-2)u{k-5) 
+ (8 . 64Qe+09) u(k-2)u{k-^) + ( -4 . 3 65e+08 ) u(k-2)u(k-7) 
+(-8.365e+10) u(k-3)u(k-31 +C2.268e+10) u(k-3)u(k"4) 
+ (1.005e+ll) u(k-3)u{k-5) + (-3 . 795e+10) u(k-3)u{k-6) 
+ {-2,516e+09) u(k"3)u(k-7) +(1.0546 + 11) u ( k'-4 ) u ( k-4 ) 
+(-1.97e+ll) u(k"4)u(k-5) +(l,109e+10) u(k-4)u(k-6) 



■y,(t)=W[u(t)] 



u(k-3) 



u(k-6) 
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+ {1.907e-fl01 u(k-4)u(lc-7) T(2.352e+10) u(k-5)u(k-5) 
+(8.173e+lQ) u(k-5)u(k-6) + (-3 . 3iae+10 ) u(k-5)u(k-7) 
+ (-4.2iae+10) u(k-6)u(k-'6) +(2.042e+10) u(k-6)u(k-7) 
+{-1.658e+09) u(k'7)u(k-7) 



5 



Linear part of the inodGi: 

y(k)=b{l)u(k)+b(2)u(k-l)'t-; , . . , +b (m) u(k-m) -a(l) y (k-1) . . 
a (n) y (k-n) 

10 with n=2 and m=303 where 

Ca(l) /a(n)] - 

-1.8 6215871605398 0.95715116734794 

[b{l) /. .■ b(m)] - 

15 l.Oe-03 * 

Columns 1 through 4 

0. 00000003328202 0.00000021432147 0.00000080368128 
0.00000227704991 

Columns 5 through 8 

20 0 .000005378 7^8 56 0 . 000011134 9910 6 0 . 0000207 9938253 

0.00003571014847 

Columns 9 through 12 

0.00005704570668 0. 00008 54847 8 679 0.00012079738459 

0,00016141668710 

25 Columns 13 through 16 

0,00020406372559 0,00024351205626 0.00027258 483896 

0.00028246765302 

Columns 17 through 20 

0.000^6339508245 0.00020572744049 0,00010137844659 
30 -0.000054^50964923 

Columns 21 through 24 

^0 ,00026181250429 -0.000513818 00480 -0 . 0007960337 3996 
-0.00108568381434 
Columns 25 through 28 
35 "0.00135214637123 -0.00155851835832 -0.00166438952001 
-0,00162976908378 
Columns 29 through 32 
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-0.00141994747987 -0 . 001010908164 48 -0.0003947 5153522 

0,00041552374840 

Columns 33 through 36 

0.00138259540242 0.00244344402372 0.00351062196838 
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IV. 2 OESICa^ OF FILTERS TO FOCUS ENERGY FROM 

DIFFKREMT FKEQnElTC? BANDS INTO A SINGLE FREQUENCY BAOT> 

The above embodimenrs of the present invention 
5 illustrate how the principles underlying the invention can 
be used to transfer energy from one frequency or frequency 
range to another frequency or frequency range. However, it 
will be appreciated that the present invention can equally 
wall be utilised to focus energy from a given fre<5uency 
10 band or given frec^uency bands into a single, and 
preferably, narrower frequency band. 

' The problem to be addressed in this design is that 
given an- input spectrum which possesses nonzero magnitude 
characteristics over two different frequency bands [a,,jb,] 
15 and [a;,^^]/ where a^>b^, a filter is required to be designed 
to focus energy from the two different input frequency 
bands into a single output frequency band [c,d], where 
c>Jbpd<a, , with the spectrum of the filter output over the 
output frequency range [c,d] satisfying certain 
20 specifications. The specifications to be satisfied can be 
specified in terms of magnitude, phase or both. 

The only difference of this design compared to the 
designs in Section I is that the determination of the 
maximum order N of the filter noniinearities should not 

25 only ensure that the specified output frequency band [c,d] 
is covered by the filter's output frequency range, but also 
should ensure that the output energy over [c,cl] is derived 
frora the input frequency range [^au^i] ^.nd the input 
frequency range [aj^i?,] , Therefore, the principles far this 

30 design are exactly the same as those described in Section I 
except for step (iii) which should follow the new principle 
above . 
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Consider an example where a nonlinear filter is to be 
designed to focus the energy from nwo different frequency 
bands [3,4] and [10,11] of an input signal 



27t 



in 



5 where h, = 4, a, =j 3. b, = 1 1, a, = 10, = 0,03 , into a single frequency 

band around frequency f=7 wirh the single output frequency 

band as small as possible and the ourput magnitude 
characteristic at freqHiency f=7 being 3M^=0.09* 

It can be shown that when subject to the excitation ot 
10 an' input with the frequency specrrum over t:wo different 
frequency bands [a,,bj and [a,,b,], the output frequency 
ranges of a nonlinear system contributed by the system's 
2nd order nonlinearity is 

[2a.2b.\\2^,;>b,\ [a,-Ha3,b,+b;], [ab, -a,]u[ab: -a,] and [a. "h,,b, -a,] 

15 Substituting 2), = 4, a, = 3, jt>. 11, a, = 10 into a, ^ b, and b, - a, 
yields 

[a, -b,,b, -a,] = [6,8] 
Clearly this output frequency range covers frequency f=7 
and the system output energy over this frequency band is 
20 derived from the input frequency range [a,,b,] = [3,4] and the 
input frequency range [a,,b,] = [10,1 1] . Therefore, the maximum 
order of system nonlinearities can be taken to be N=:2 for 
this specific design. 

Moreover, following the same design principles as 
25 described in Section I, a discrete time nonlinear filter 
under the sampling period T^^\IS(is can be obtained for this 

specific design. Figure 36 illustrates schematically such 
a filter. 
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Figures 37 and 38 show the input and output frequency 
spectra of this filter respectively and clearly indicate 
that the input energy over the two different input 
frequency bands [3,4] and [10,11] have been, as required, 
5 successfully focused into a very small band around 
frequency f=7. 

ry,3 DESIGN OF SPATIAL DCbgaN NONLINEAR FILTERS 

Although the above embodiments have been described 
10 with reference to the' design of non-linear time-domain 
systems, it will be appreciated that the present invention 
is equally applicable to non-linear spatial-domain systems. 

In •i:he one dimensional case, the present invention can 
be directly applied and the only difference of the one- 
15 dimensional spacial domain case over the above time-domain 
embodiments is that the time-doma.in variables z and k in 
the , continuous and discrete time filter equations become 
the continuous and discrete sparial variables X and in 
the spatial domain filter equations. 

20 Consider a one dimensional spatial domain filtering 

problem that is the same as the second problem addressed in 
Section II. 1 except that the time variables t and k become 
the spatial variables X and in the present design. 

Figure 39 shows the block diagram of the spatial 
25 domaia nonlinear filter designed in this case. It can be 
seen that- the spatial-domain filter is exactly the same as 
that shown in figure 9 which is the block diagram of zhe 
corresponding time domain nonlinear filter designed in 
Section II. 1 except that the time variables t, k, T, and 
30 s (second) in figure 9 have been changed to the spatial 
variables X, X^,, AX, and m (meter) in figure 39. 

Figures 40 and 41 show the effects of spatial domain 
nonlinear filter. Again, except for the time variables 
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being changed zo spatial variables, the figures are the 
sarue as figures 11 and 13 which are the results of the 
corresponding time domain nonlinear filter. 

The filtering effect in the time domain of the second 
5 nonlinear filter designed in Section II. 1 indicates an 
energy transfer from the input frequencies = 1 and ^2 
to the ouTipux: frequency p/^£j=4. Figure 40 indicates the same 
effect but in the spatial domain. In this case, the spatial 
domain nonlinear filter transfers energy from the input 
10 spatial frequencies ='I and w,, = 2 to the outpur spatial 
frequency 

When- this one dimensional spatial domain nonlinear 
fi-lter is applied for one dimensional image processing, 
where figure 41 represents the intensities over the spatial 

15 variable X of the images before and after the processing, 
the energy transformation effect of the spatial domain 
nonlinear filter can be further illustrated by figures 42 
and 43. Figure 42 shows the one dimensional input image 
with energy located in spatial frequencies and w^^ =2 

20 and figure 43 shows the one dimensional outpur image . with 
energy located in another spatial frequency w^^^4 due to 
the effect of nonlinear filtering. 

Although the present invention has been described 
25 above with reference to a one dimensional case in the 
spatial domain, it will be appreciated that the present 
invention is not limited thereto. The present invention can 
equally well be applied to the design and implementation of 
non-linear systems for realising transfer of energy from 
30 first m-dimensional spatial domain frequencies to specified 
second n-dimensional spatial domain frequencies, where m 
and n are greater than one. 
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It will be appreciated thar an application of the 
transfer of energy from first m- dimensional spatial domain 
frequencies to specified second n-dimensional spatial 
domain frequencies would be digital image processing or 
5 filtering. In such a case m=n=2. The present invention 
can be designed to produce filters chat: operate upon 
digital images. The filters can be designed to perform 
numerous different functions such as, for example, image 
compression or filtering to remove noise or vary the colour 
10 space of an image. 

The phrase "transfer of energy*' includes, without 
limitation, .the processing of a first signal, specified in 
the time domain or spatial domain, to produce second signal 
having predeterminabie characteristics including a 
15 specified energy distribution. 

Furthermore, it will be appreciated that rhe terms 
"frequency range" and "range of frequencies" includes a 
group of frequencies or frequency group. A group of 
frequencies comprises a plurality of frequencies spatially 
20 distributed within an n-dimensional space or over a 
subspace . 

It will be appreciated' by those skilled in the art 
that the phrase "specified spectrum'" relates to the 
specification of at least one of either the magnitude and 
25 phase of a signal or frequency coinponents of a signal and 
is effually applicable to situations in which only the 
magnitude is specified and to situations in which both the 
magnitude and phase are specified. 

It will be appreciated that the input and output 
30 signals of any or all of the various embodiments of the 
present invention may be time or spatial domain continuous 
or discrete input or output signals. 
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Referring to figure 44 there is shown a data processing 
system 4400 upon which embodiments of the present invention, 
that is to say, the non-linear systems and the methods of 
design thereof can be implemented or realised. It will also 
5 be appreciated that the non-linear 5y5T:ems so designed may be 
implemented in digital form using the data processing system 
or other suitable hardware and software. The data processing 
system 4400 comprises a central processing unit 4402 for 
processing computer instructions for implementing the design 
10 of nonlinear systems , given an input signal and particular 
outpuE signal requirements. The data processing system also 
comprises a raemox-y 4404 for storing data to be processed or 
the results *of processing as well as computer program 
instructions for processing such data, a system bus 4406, an 
input device 4408, an output device 4410 and a mass storage 
device, for example, a hard disc drive 4412. 
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